Deep-Learning-Incorporated Augmented Reality Application for Engineering Lab Training

Deep learning (DL) algorithms have achieved significantly high performance in object detection tasks. At the same time, augmented reality (AR) techniques are transforming ways that we work and connect with people. With increasing popularity of online hybrid learning, propose a new framework for improving students’ experiences electrical engineering lab equipment by incorporating abovementioned technologies. The DL powered automatic component integrated into AR application is designed to recognize such as multimeter, oscilloscope, wave generator, power supply. A deep neural network model, namely MobileNet-SSD v2, implemented using TensorFlow’s API. When piece detected, corresponding AR-based tutorial will be displayed on screen. mean average precision (mAP) developed model 81.4%, while recall 85.3%. Furthermore, demonstrate practical proposed framework, develop multimeter where virtual models superimposed real multimeters. includes images web links well help users learn more effectively. Unity3D game engine used primary development tool this integrate frameworks create immersive scenarios. can useful foundation machine-learning-based industrial educational training.